Telegram Group & Telegram Channel
πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub



tg-me.com/machinelearning_interview/1792
Create:
Last Update:

πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub

BY Machine learning Interview




Share with your friend now:
tg-me.com/machinelearning_interview/1792

View MORE
Open in Telegram


Machine learning Interview Telegram | DID YOU KNOW?

Date: |

Telegram Auto-Delete Messages in Any Chat

Some messages aren’t supposed to last forever. There are some Telegram groups and conversations where it’s best if messages are automatically deleted in a day or a week. Here’s how to auto-delete messages in any Telegram chat. You can enable the auto-delete feature on a per-chat basis. It works for both one-on-one conversations and group chats. Previously, you needed to use the Secret Chat feature to automatically delete messages after a set time. At the time of writing, you can choose to automatically delete messages after a day or a week. Telegram starts the timer once they are sent, not after they are read. This won’t affect the messages that were sent before enabling the feature.

Telegram Gives Up On Crypto Blockchain Project

Durov said on his Telegram channel today that the two and a half year blockchain and crypto project has been put to sleep. Ironically, after leaving Russia because the government wanted his encryption keys to his social media firm, Durov’s cryptocurrency idea lost steam because of a U.S. court. β€œThe technology we created allowed for an open, free, decentralized exchange of value and ideas. TON had the potential to revolutionize how people store and transfer funds and information,” he wrote on his channel. β€œUnfortunately, a U.S. court stopped TON from happening.”

Machine learning Interview from ca


Telegram Machine learning Interview
FROM USA